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PATENT 

IN THE UNITED STATES PATENT OFFICE 

Serial No . : Not yet assigned 
Filed: Herewith 

For: DEVICE AND METHOD FOR DETECTING 
THE PHASE AND AMPLITUDE OF 
ELECTROMAGNETIC WAVES 

Inventor: Rudolf Schwarte 

AttyDoc.No.: 752-00 

PRELIMINARY AMENDMENT 

Assistant Commissioner 

for Patents 
Washington, D.C. 20231 

Dear Sirs: 

Please amend the above-identified application as follows: 
In the Claims : 

Claim 4 line 1, change "3" to —2—; 
Claim 5, line 1, change "4" to — 2— ; 
Claim 6, line 1, change "5" to -2— ; 
Claim 7, line 1, change "6" to —2—; 
Claim 8, line 1, change "7" to —2— ; 
Claim 10, line 1, delete "or claim 9"; 

Claim 11, line 1, change "in one of claims 8 or 9" to —claim 8-; 
Claim 14, line 1, change "one of claims 1 through 12" to --claim 2— ; 
Claim 15, line 1, change "one of claims 1 through 14" to —claim 2-; 



Claim 16, line 1, change "one of claims 1 through 15" to -claim 2— ; 
Claim 17, line 1, change "one of claims 1 through 16" to —claim 2—; 
Claim 18, line 1, delete "and claim 17"; 

Claim 19, line 1, change "one of claims through 18" to -claim 1—; 
Claim 20, line 1, change "one of claims 1 through 19" to — 1-; 
Claim 21, lines 1 and 2, change "one of claims 1 through 18" to —claim 1— ; 
Claim 22, line 1, change "one of claims 1 through 18" to —claim 1—; 
Claim 23, lines 1 and 2, change "through 18 and 22" to --and 2-. 



The above amendments to the claims have been made to place the claims in 
proper U.S. form and to eliminate multiple dependent claims from depending from other 
multiple dependent claims. 



REMARKS 



Respectfully submitted, 




'^eg. No. 23,028 
'Paul & Paul 
2900 Two Thousand Market Street 
Philadelphia, PA 19103 
(215) 568-4900 
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convey or license, any rights in the invention to any person who could not be classified as an independent inventor 
under 37 CFR 1.9(c) if that person had made tho invention, or to any concern which would not qualify as a smail 
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ATTY DOC. 752-00 

Apparatus and method for detecting the phase and 
amplitude of electromagnetic waves 

5 

The invention concerns an apparatus for detecting the phase and 
amplitude of electromagnetic waves, more specifically preferably in the 
optical and in the near infrared and ultraviolet range, comprising at least 

10 two modulation photogates which are sensitive to the electromagnetic 
waves (or photosensitive) and accumulation gates which are associated 
with the modulation photogates and which are not photosensitive or 
shaded, and electrical connections for the modulation photogates and the 
accumulation gates so that the latter can be connected to a reading-out 

15 device and the former can be connected to a modulating device, wherein 
the modulating device increases or reduces the potential of the modulation 
photogates relative to each other and also relative to the preferably 
constant potential of the accumulation gates corresponding to a desired 
modulation function. 

20 Such an apparatus is known by the term 'photomixing detector' 

(abbreviated as PMD) from German patent applications Nos 196 35 932.5 
and 197 04 496.4 and international patent application PCT/DE97/01956 
based on the two applications referred to above. 

The above-indicated applications are to the same inventor and were 

25 filed for the applicant of the present application, and reference is made to 
the entire disclosure of those previous applications insofar as described 
therein are the basic mode of operation, performance and possible uses of 
photomixing detectors. The present invention therefore does not discuss 
those fundamental functions of photomixing detectors but is concerned 

30 primarily with specific configurations and uses of photomixing detectors, 
by which the elements that are already known are optimised. 

By virtue of the inherent mixing procedure which is implemented 
upon reception of the light which is modulated, reflected or emitted by an 
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object, by the modulation photogates which are moduiated with the same 
modulation function, the known PMDs are in a position directly to detect 
the transit time of the electromagnetic waves reflected by the object and 
therewith, besides lateral locational resolution which is ensured by means 
5 of a suitable optical system as in conventional cameras, simultaneously 
also to obtain items of spacing information about the recorded pixels. 
Those PMDs therefore permit direct three-dimensional surveying and 
measurement of surfaces without the need for expensive evaluation 
procedures and recording procedures at various angles. 

10 In order to achieve adequate sensitivity and depth resolution in the 

case of the known PMDs, the pixel surfaces must be sufficiently large so 
that, during the recording duration of an individual image, sufficient 
electromagnetic radiation is received from the various surface regions of 
the object and a suitable number of charge carriers is produced in the 

15 photosensitive material as ultimately the spacing information is obtained 
by way of the different number of charge carriers which occur at different 
moments in time at the modulation photogates and are accumulated by 
way of the immediately adjoining accumulation gates. 

That entails a certain minimum size in regard to the area of the 

20 individual pixels. Problems can also occur with the conventional PMDs by 
virtue of the fact that very sharp light-dark boundaries of the object are 
produced in the image. If such a light-dark boundary falls by chance on 
the boundary region between adjacent modulation photogates, then the 
different number of charge carriers at the adjacent accumulation gates 

25 thus fakes a correlation result which leads to incorrect interpretation in the 
sense of depth information. 

In addition the transit times in photosensitive pixel elements of that 
kind, which are of relatively large area, are comparatively long so that the 
band width or the limit value of the modulation frequency is usually only in 

30 the region of a few megahertz to a maximum of 100 MHz. Band widths of 
at least 1 GHz are desired in particular for the use of corresponding 
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photosensitive detectors, for example in the opto-eiectronic art and in 
optical signal transmission. 

In addition a higher level of functionality and flexible use of the 
PMD-pixels and PMD-arrays is desirable for different uses, for example for 
5 implementing different modes of operation with the same pixels, .in 
particular for reasons of economy. 

Having regard to the foregoing, the object of the present invention 
is to provide an apparatus for detecting the phase and amplitude of 
electromagnetic waves, having the features set forth in the opening part 
10 of this specification, which has a markedly improved band width, in which 
moreover misinterpretations of light-dark boundaries on imaged surfaces 
are less probable or even excluded, and with which a higher level of 
functionality and economy in practical uses is achieved. 

That object is attained in that the modulation photogates like also 
15 the accumulation gates are provided in the form of long narrow parallel 
strips in mutually juxtaposed relationship, which group-wise form a PMD- 
pixei, and wherein the accumulation gates are in the form of reading-out 
diodes. 

The fact that the modulation photogates and the accumulation 
20 gates are in the form of narrow long strips and the arrangement thereof in 
parallel directly mutually juxtaposed relationship results in very short 
channel lengths for the gates (the modulation gate strip width is referred 
to as the gate length, from MOS-transistor technology). The free charge 
carriers produced in or under the modulation photogates drift only 
25 transversely with respect to the strip direction by the short distance of the 
gate length to the adjoining accumulation gate, in which respect that drift 
is supported by a suitable electrical field on the part of the modulation 
voltage at the modulation photogates. As a result the drift times fall for 
example below 1 nanosecond so that accordingly it is possible to achieve a 
30 usable modulation band width of 1 GHz. Even if the individual strips of the 
modulation photogates and also the accumulation gates are relatively 



3 



narrow, nonetheless by virtue of their corresponding length they can 
afford a sufficiently large photosensitive area while in addition it will be 
appreciated that a plurality of alternately arranged, strip-shaped 
modulation photogates and accumulation gates can be connected together 
5 to form a unit with almost a doubling of the optical filling factor. In that 
way virtually any pixel shapes and pixel sizes can be embodied by strip 
structures of that kind, without a limitation in terms of modulation band 
width. 

The preferred embodiment of the invention provides that the 

10 individual modulation photogates are of a width which is greater than that 
of the respectively adjoining accumulation gates, while in addition the 
width of the modulation photogates shouid if possible be smaller than the 
diffraction limit of the imaging optical system for the modulated light 
detected by those elements, and shouid preferably be of the order of 

15 magnitude of the wavelength or a few wavelengths of that light or that 
electromagnetic wave. This means that, by virtue of diffraction effects, 
sharp iight-dark boundaries can no longer accidentally fall on the region 
between two adjacent modulation photogates which are modulated in 
push-pull relationship. On the contrary the small dimensions of the 

20 modulation photogates in the transverse direction provide that a shadow 
or light-dark boundary must be spread over the full width of those gates 
so that both adjacent gates are equally still acted upon by light. In 
addition, with very long, correspondingly narrow modulation photogates, it 
is in any case highly improbable that a light-dark boundary extends 

25 precisely parallel to the direction of those strips. With the slightest 
inclination relative to the strips however at any event the two adjacent 
modulation photogates which are modulated in push-pull relationship are 
substantially equally acted upon with light from the light part and the dark 
part of the respective object whose image is produced. 

30 The strip length of the modulation photogates and also of the 

accumulation gates shouid if possible be at least ten times to one hundred 
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times the width thereof. The width of the pixels formed from a plurality of 
modulation photogates and accumulation gates should overall be 
approximately of the same order of magnitude as the length, which means 
that about 10 - 100 strips are to be arranged in mutually juxtaposed 
5 relationship, of which about a third are accumulation gates and about two 
thirds are modulation photogates. In another embodiment of the invention 
however it is possible also to arrange three or even more modulation 
photogates in the form of corresponding strips to improve the potential 
configuration between each two accumulation gates, in which case the 

10 central modulation photogate should be unmodulated. In addition, a 
preferred embodiment of the invention is one In which, as viewed in the 
transverse direction with respect to the strips, in a pixel, there are always 
two modulation photogate strips alternating with an accumulation gate 
strip, wherein the two immediately mutually juxtaposed modulation 

15 photogates are connected in such a way that their potential can be 
modulated in push-pull relationship with respect to each other, wherein 
the accumulation gates each have a preferably constant, lower energy 
potential, that is to say for example positive potential for the 
photoelectrons, which provides that the charge carriers produced under 

20 the two modulation photogates drift predominantly to the side of that 
modulation photogate which assumes the low energy potential value and 
from there go to the accumulation gate arranged on that side of the two 
strips. In that case the two modulation photogate strips which are 
arranged on respective sides of an accumulation gate are modulated in 

25 push-pull relationship, that is to say at a given moment in time an 
accumulation gate simultaneously receives charge carriers from both 
modulation photogate strips adjacent thereto while the respectively 
adjacent accumulation gate is adjacent to two modulation photogate strips 
which at that moment in time are precisely at a higher potential so that 

30 only very few charge carriers go to that accumulation gate. Accordingly 
each second respective accumulation gate is also connected to one and 



5 



the same reading-out line and the remaining accumulation gates are 
connected to another reading-out line, wherein the sum signal of those 
two lines reproduces the amplitude of the received light while the 
difference signal directly specifies the value of the correlation signal which 
5 arises out of modulation of the received light and simultaneous modulation 
with the same modulation function of the directly adjacent modulation 
photogates in push-pull relationship. That also occurs in a completely 
analogous fashion when using a third modulation photogate which would 
additionally be arranged between the two above-mentioned modulation 

10 photogates and which for example could be disposed at a constant mean 
potential whiie the two adjacent photogates could be increased and 
reduced with the modulation voltage in push-pull relationship relative to 
the central gate. In that way the potential configuration can also be 
smoothed somewhat and the level of efficiency in regard to unilateral 

15 displacement of the charge carriers could be increased in accordance with 
the respective current value of the modulation voltage. 

In accordance with the invention the accumulation gates are in the 
form of reading-out diodes. 

In the possible voltage reading-out mode the photocharges which 

20 are distributed in accordance with the push-pull modulation voltages are 
stored on the capacitances of the accumulation gates - in this case on the 
barrier layer capacitances of the reading-out diodes which are connected 
in the blocking direction (for example pn-diodes or Schottky diodes) - and 
ascertained with a high-ohmic reading-out apparatus. 

25 In the current reading-out mode which is preferred herein the 

arriving photocharge is transmitted directly to the reading-out circuit with 
a practically unaltered potential of the reading-out electrode. 

As in the case of the semiconductor materials which are current at 
the present time for the uses of this invention, electron mobility is greater 

30 than that of the holes or defect electrons, preferably photoelectrons are 
directionally modulated by the modulation photogates and distributed in 
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accordance with the modulation voltage to the accumulation gates or 
reading-out diodes. In this case the anodes of the reading-out diodes are 
preferably at common ground potential while the cathodes are at positive 
potential and are connected as reading-out electrodes K+ and K. 
5 respectively to the reading-out circuit. 

The above-discussed two kinds of accumulation gates K+ and K. 
alternate with each other in a group of accumulator gates and modulation 
gates which in accordance with the invention operate in parallel and which 
form a novel PMD-pixel of highest band width, in accordance with the 

10 invention, in a manner such that for example a positive modulation 
photogate voltage results in a photocharge enrichment at the K+- 
accumulation gates or a photocharge depletion at the K.-accumulation 
gates, wherein the accumulation gates are used double by virtue of the 
double-sided charge accumulation and almost double the optical degree of 

15 filling internal to the pixels and noticeably reduce parasitic capacitances. 

In a preferred embodiment of the invention two pixels respectively 
comprising a plurality of parallel strips of modulation photogates and 
accumulation gates are arranged in directly mutually juxtaposed 
relationship, here referred to as 2-quadrature pixels. In this respect it is to 

20 be pointed out that in the transverse direction the pixels are respectively 
terminated by an individual modulation photogate adjoining the last 
accumulation gate strip in that direction, and not by a pair, as is the case 
between the accumulation gates. If two such pixels are arranged in 
directly mutually juxtaposed relationship, then those two terminal strips 

25 which each form a respective modulation photogate of a respective one of 
the two pixels come to lie in mutually juxtaposed relationship and the two 
pixels which are separated in themselves can now be modulated in such a 
way that the two mutually juxtaposed modulation photogates are 
modulated in push-pull relationship with respect to each other, which 

30 effectively amounts to having the pixel surface area doubled at the same 
modulation voltage and phase, with a unitary larger pixel being formed 
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from the two individual pixels. As however in this configuration the two 
halves of that larger pixel can in principle be modulated independently of 
each other, the modulation function can equally well also be displaced in 
respect of phase or transit time in regard to the one pixel through 90° or a 
5 suitable delay T D , in relation to the other pixel. That means that in-phase 
and quadrature signals are measured at the same time so that in that 
fashion complete information about the phase position of the correlation 
function is obtained in parallel and simultaneous relationship. 

In that case the accumulation gate connections or terminals are 

10 desirably respectively provided at the end of one of the pixels. The 
modulation photogate connections or terminals are preferably provided in 
the form of push-pull strip lines from both ends or strip ends of the pixel 
surfaces, more specifically in particular in the case of especially long strips 
in addition by virtue of transversely extending push-pull strip lengths in 

15 each case as a multiple and at equal spacings. That prevents the 
modulation signal being attenuated and deformed over the length of the 
gate by virtue of the electrical surface resistance of the modulation 
photogate, so that the ascertained correlation function is also 
correspondingly deformed. 

20 A particularly preferred embodiment of the invention is one in which 

four pixels are arranged in a rectangle or square and form a unit, more 
specifically in such a way that the strips of pixels arranged in the square 
or rectangle in respective diagonal relationship with each other extend 
parallel to each other while the strips of the directly adjacently disposed 

25 pixels extend perpendicularly to each other, thereby substantially avoiding 
in particular troublesome mutual overcoupling effects. This embodiment is 
referred to herein as 4 quadrant (4Q)-PMD-pixels. If the pixels themselves 
are square then the pixel element composed of the four quadrants is also 
square and by phase shift of modulation as between diagonally mutually 

30 opposite pixels it is possible simultaneously to detect the push-pull 
correlation values of the in-phase and quadrature signals. 



In addition a further embodiment of the invention is preferred in 
which arranged over the modulation photogates and the accumulation 
gates are corresponding strip-shaped lenses, specifically therefore 
cylindrical lenses, which focus the light impinging on the lenses on to the 
5 modulation photogates so that the surface components which are 
occupied by the non-photosensitive accumulation gates also still 
effectively contribute to the light yield. If the coupled-in modulated iight is 
relatively narrow-band in nature, the strip structure can be so 
dimensioned for a mean wavelength of such light that the coupling-in 
10 factor, in accordance with the wave theory, is markedly greater, or the 
reflection factor is markedly smaller, than corresponds to the reflection 
factors in accordance with geometrical optics. In that case it is possible to 
involve an improvement in the modulation photogates and to promote 
such a measure. 

15 A plurality of pixels can either be connected together to form a 

linear array or a matrix array, in which respect a preferred embodiment is 
one in which arranged over the individual pixels are microlenses which 
direct the incident light which in part is also directed on to regions which 
are between the pixels and do not contribute to evaluation through the 

20 microlenses on to the photosensitive pixel surfaces. 

A 4Q-PMD-pixel, with four times the same or with differing 
modulation, can measure the points of concentration of the four square 
sub-pixels and at the same time ascertain the overall phase or transit time 
of the 4Q-PMD-pixel by averaging of ail 4 correlation values. The four 

25 individual concentration point transit times supply in that case the gradient 
or normal vector of the imaged surface element and permit improved 
interpolation of the 3D-surface to be measured, between the adjacent 
pixels of an array. 

Finally a particularly preferred embodiment of the invention is one 

30 in which the pixels, that is to say the individual modulation photogates and 
the accumulation gates are implemented using CMOS-technology. That is 
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a very inexpensive and well-established technology which permits mass 
production of corresponding elements and at the same time also allows 
on-chip and multi-chip module integration of the peripheral electronics 
such as the evaluation electronics and the modulation electronics. 
5 In CMOS-technology both conventional CMOS-pixels with ZD- 

functionality (so-called 2D-pixels) and also PMD-pixels with 3D- 
functionality (so-called 3D-pixeis) can be integrated in a linear array or in 
a matrix array in a mixed configuration. In this case the various, in 
particular adjacent items of pixei information can be evaluated in a 

10 downstream-disposed, data-fusioning and interpolating apparatus, in 
terms of rapid reconstruction of the complete 3D-color/depth image by 
means of the items of color information of the 2D-pixels and the 3D-depth 
and 2D-gray value information of the 3D-PMD-pixels, which affords totally 
new options in regard to optical measurement procedures and in 

15 automation, object identification, security technology and multi-media 
technology. 

Further advantages, features and possible uses of the present 
invention will be apparent from the description hereinafter of preferred 
embodiments and the accompanying drawings in which: 
20 Figure 1 is a plan view of a pixel of a first embodiment of the 

present invention, 

Figure 2 shows the interconnection of two adjacent pixels, 
Figure 3 shows a portion from a view in cross-section through the 
pixel elements shown in Figure 2, in a section taken along line III-III in 
25 Figure 2, 

Figure 4 is a plan view on an enlarged scale of a portion of the 
double pixel or 2-quadrant pixel shown in Figure 2, 

Figure 5 is a view in section transversely to the strip direction 
through a pixel in another embodiment of the present invention with in 
30 each case three modulation photogates between two respective 
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accumulation gates and a buried n-layer and with modulation photogate 
electrodes embedded in the insulating material, 

Figure 6 is a plan view of the 3-gate structure of a PMD-pixel in a 
multi-strip technology as shown in Figure 5 in a view corresponding to 
5 Figure 4, 

Figure 7 is a perspective view of a portion of the pixel shown in 
Figures 5 and 6, 

Figure 8 shows four pixel elements which are connected together 
with different strip orientations and which form a pixel unit for various 
10 modes of operation, 

Figure 9 shows a field comprising 2x4 pixels as shown in Figure 8, 
Figure 10 diagrammaticaily shows the mode of operation of a 3D- 
camera which is constructed from a relatively large field of pixel elements 
similarly to Figure 9, 
15 Figure 11 shows an optical PLL-circuit or DLL-circuit on a PMD basis 

for light barriers, time lapse or delay cameras and data light barriers with 
optional data signal regeneration, and 

Figure 12 shows a login amplifier circuit for measuring in-phase and 
quadrature signals and signals with band spread technology in particular 
20 for high-sensitivity data light barriers, for phase transit time 
measurements and for optical data transmission preferably in optical 
CDMA (Code Division Multiple Access) systems and with optional data 
signal regeneration. 

Shown in the middle part of Figure 1 is a row of parallel vertical 
25 strips, wherein the light strips reproduce photosensitive, semitransparent 
modulation photogates while the dark strips which are identified by 
references 4 -and 5 correspond to light-opaquely covered accumulation 
gates or reading-out gates. The narrow black vertical strips represent 
insulating separating surfaces between adjacent modulation photogates 1 
30 and 2. 
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The modulation photogates are here distinguished by references 1 
and 2 because the modulation photogates denoted by the same reference 

1 are also modulated in push-pull relationship with each other while the 
potential of the modulation photogates which in turn are denoted by 

5 reference 2 which is the same in relation thereto are modulated in push- 
pull relationship with the modulation photogates 1. M in the lower part 
diagrammatically indicates the modulation circuit, in particular the 
modulation electronics and connections or terminals 8 of the modulation 
voltage supply. A in the upper part of Figure 1 diagrammatically shows the 

10 reading-out circuit, in particular the reading-out electronics and 
connections or terminals and a signal processing arrangement connected 
to the accumulation gates 4 and 5 respectively. In this case, all 
accumulation gates 4, that is to say every second accumulation gate, is 
connected to a first common reading-out line and the accumulation gates 

15 5 disposed therebetween are connected to another common reading-out 
line. The reading-out circuit ascertains the sum signal U E and also the 
difference U from the photocharges of the accumulation gates 4 and 5. U E 
is a measurement in respect of the sum of the total photocharges which 
are averaged in respect of time while U is a measurement in respect of the 

20 difference of the photocharges at the accumulation gates 4 and 5 or K+ 
and K- respectively. The modulation photogates 1 are for example 
connected to the voltage terminal +U m (t) when the modulation photogates 

2 are connected to the voltage terminal -U m (t). The modulation voltage is 
preferably a pseudo-noise voltage or also a pseudo-random voltage, but it 

25 would also be possible to use any other encoded modulation signal with a 
suitable narrow correlation function and an adequate word length. 

If the modulation photogates 1 are at a low voltage level while the 
modulation photogates 2 are at a high voltage level the charge carriers, 
being photoelectrons in the embodiment of Figures 3 and 4, are passed 

30 predominantly or almost exclusively only to the accumulation gates 4 
while the accumulation gates 5 collect no or almost no charges. If the 
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voltage conditions are reversed and the modulation photogates 1 are 
therefore at high potential while the modulation photogates 2 are at low 
potential, then the charge carriers flow away almost exclusively by way of 
the accumulation gates 5. In the event of the charge carriers produced 
5 involving a substantial variation in respect of time which is produced by 
illumination, varying with the same function, of an object whose image is 
recorded by the pixel, that also affords information about the moment in 
time at which the charge carriers were produced on the photosensitive 
surfaces. Modulation of the modulation photogates with the same 
10 modulation function as that with which illumination of the object is also 
modulated then furnishes as the signal U the correlation function which 
contains the items of information relating to the distance of the imaged 
pixel. 

As will be seen, the strips are very narrow in comparison with their 

15 length, in which respect the corresponding conditions are not shown true 
to scale in the Figures. On the contrary, in practice the individual strips are 
even substantially longer in relation to their width. The narrow strips 
correspond to a very short gate length, that is to say a very short drift 
distance for charge carriers which are produced under a modulation 

20 photogate 1 or 2, to one of the reading-out gates 4 or 5. The 
correspondingly short drift times permit corresponding fast modulation 
signals and therefore result in a high band width. 

In order however not to have an adverse effect on the level of 
measurement accuracy by virtue of the resistance of the modulation 

25 photogates in their longitudinal direction, a plurality of modulation 
connections or terminals mi, m 2 and m 3 are respectively connected in 
parallel at equal spacings with respect to each other preferably from the 
top side of the pixel to the respective modulation photogates 1 and 2 so 
that modulation can be effected simultaneously at the respective 

30 connecting points of the connecting lines m l7 m 2 and m 3 , in which respect 
it will be appreciated that the number of said connections can be varied 
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and adapted according to the requirements and according to the length of 
the individual strips. 

Alternatively or in addition, this problem can be resolved if the 
modulation photogates directly adjoining the accumulation gates 4, 5, on 
5 the side of the strip which is towards the accumulation gates, in part 
involve a strip-shaped covering of for example between a quarter and a 
third of the modulation photogate width, by means of a contacting strip of 
high conductivity and of no or very slight transparency for the 
electromagnetic waves, preferably in the form of a metal film applied to 

10 the modulation photogate, that measure being adapted to focusing of the 
light in the pixel region by the cylindrical lenses according to the invention. 

In addition the modulation photogates 1 and 2 may also directly 
involve an end connection from the block identified by M at the bottom. 

Figure 2 diagrammaticaliy shows a pixel which is composed of two 

15 identical pixel elements 10, 10' which are each only of half the width in 
comparison with the pixel element 10 shown in Figure 1. For the sake of 
clarity the additional modulation connections mi, m 2 and m 3 are not 
shown herein but could obviously also be present. 

The two strip fields of these pixels 10, 10' are arranged in directly 

20 mutually juxtaposed relationship so that two individual modulation 
photogates 2 and 1 respectively are disposed in mutually juxtaposed 
relationship in the center at the interface between the two pixels 10, 10'. 
Each of the pixels 10, 10' has its own modulation voltage supply and also 
its own reading-out circuit and its own reading-out lines. If the modulation 

25 voltages of the pixel 10' are applied in relation to those of the pixel 10 in 
such a way that the strip 2 of the pixel 10 is modulated in push-pul! 
relationship with the strip 1 of the pixel 10', the two pixel elements co- 
operate just like the larger pixel 10 of Figure 1 illustrated above. It is 
however also possible to choose the modulation voltage of the pixel 10' as 

30 being phase-shifted through 90° relative to the modulation voltage of the 
pixel 10, which corresponds to an in-phase and a quadrature signal. 
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Accordingly here the individual voltages, and the modulation and the 
evaluation circuit are additionally identified by the index I for 'in-phase' 
and the corresponding circuits and voltage symbols of the pixei 10' are 
identified by the additional index Q for 'quadrature'. 
5 Figure 3 diagrammatically shows a specific physical structure of the 

double pixel illustrated in Figure 2. It will be seen that this double pixel is 
disposed on a common substrate and that the arrangement and sequence 
of the individual modulation photogate layers, insulating layers and 
accumulation gate layers does not differ from the arrangement which 

10 would also be involved in the case of the larger pixel shown in Figure 1. 
Only the electrical connections are completely separated from each other 
for the right-hand and left-hand pixel halves so that it is possible for 
modulation of the modulation photogates arranged in the right-hand half 
to be selected independently of modulation of the modulation photogates 

15 arranged in the left-hand half, which, as already mentioned, permits 
separation of the signals into in-phase and quadrature signals and 
enhances the versatility of the PMD-pixel. 

Figure 4 is simply a plan view which essentially also corresponds to 
the plan view in Figure 2, but the individual strip elements are illustrated 

20 as being interrupted in terms of their length in order to be able to show 
the overall arrangement on an enlarged scale, while the individual 
connections of the modulation photogates to the modulation circuit and 
also the connections of the reading-out circuits to the accumulation gates 
4 and 5 are additionally illustrated in detail. 

25 Figures 5 through 7 show a further alternative embodiment of the 

invention, in which a further modulation photogate 3 is also additionally 
provided between the modulation photogates 1 and 2, as have already 
been described with reference to Figures 1 through 4. In this case the 
circuit symbols at the right in each of Figures 5 through 7 indicate that this 

30 central modulation photogate is held at a constant potential and relative 
thereto the modulati on photogates 1 and 2 are increased and reduced in 
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their potential in accordance with the modulation function. That results in 
a generally flattened potential configuration and a still better channel 
separation effect, a higher drift speed and a lower level of modulation 
power. 

5 In this respect, Figure 5 is a view in section similarly to Figure 3, 

but without the pixel in this case being divided into a plurality of portions. 
Figure 5 illustrates an advantageous configuration with a buried n-layer 
and with modulation gate electrodes which are embedded in the insulating 
material, which is advantageous for very small structures, in comparison 

10 with overlapping gate structures. Figure 6 shows a view from above 
similarly to Figure 4 and Figure 7 shows a perspective view of this 
photomixing detector PMD. 

Figure 8 shows four pixel elements which are composed of strip- 
shaped modulation photogates and accumulation gates and which are 

15 each of a substantially square shape and which are assembled to form a 
pixel which is once again square overall, wherein the strips in the 
quadrants which are arranged in diagonal relationship with each other 
respectively extend parallel to each other while they extend 
perpendicularly to each other between adjacent quadrants. That 

20 substantially suppresses mutual overcoupling and falsification of different 
adjacent modulation signals. In that arrangement the evaluation circuits 
are moved to those sides of the square which can be arranged outside the 
square pixel surface. In this case also modulation of the modulation 
photogates is preferably again effected with a modulation voltage signal 

25 which, for two quadrants in mutually diagonal relationship, relative to the 
other two diagonally arranged quadrants, is phase-shifted through 90° or 
is delayed by a chip width T Chl p in the case of PM-modulation, which in turn 
results in simultaneous measurement of in-phase and quadrature signals. 
The modulation voltage lines which overlap at the center can be closed for 

30 1-quadrant operation, for 2-quadrant operation they can be only 
horizontally and vertically connected and for separate 4-quadrant 
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operation they can be open. It is however also advantageous, in the 
situation involving 4 identical modulation signals and thus preferably 
connected lines, to provide for reading-out separately four times. The 
required IQ-value pairs for transit time determination can also be 
5 ascertained in a time multiplex manner in the 1-quadrant mode of 
operation. In the alternative heterodyne process the 4 correlation 
functions can pass through, with the beat frequency, and in that way the 
items of spacing information can be ascertained. 

Figure 9 shows a panel or field of 2 x 8 pixels of the kind shown in 

10 Figure 8. Arranged over each of those pixels which are here generally 
denoted by reference 100 is a microiens 6 which serves to focus the light 
impinging on the surface covered by the entire pixel field substantially on 
to the actual photosensitive surfaces of the pixels. The drawing does not 
show strip lenses which are arranged extending parallel to the strips on 

15 the individual pixels and which cover the entire pixel surface in such a way 
that the light impinging on the strip lenses is concentrated only on to the 
regions between the accumulation gates, that is to say only on to the 
modulation photogates. 

Figure 10 shows the principle of a 3D-camera equipped with the 

20 pixels 100 according to the invention. A generator 11, in this example a 
PN (pseudo noise) generator, controls an optical transmitter, here a laser 
diode 12 whose light is projected by way of an optical device 13 on to the 
surface of an object 7. In this case, the light intensity is modulated with 
the modulation signal of the generator 11. The correspondingly reflected 

25 and likewise modulated light is projected by way of a camera optics 14 on 
to an array of image pixels 100 which in particular can be in the form of 
the pixels or photomixing elements shown in Figure 8. 

They are modulated with a delay member 15 with an adjustable 
time delay T D for the I-output and an additional fixed time delay T ctlip for 

30 the Q-output with the same modulation signal from the PN-generator 11 
as also the diode 12, but in push-pull relationship. The modulated received 
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light signal is therefore correlated twice per pixel with the same 
modulation function by means of the modulation photogates so that that 
entails transit time information and thus also spacing information of 
individual elements of the surface of the object 7. 
5 In the case of the configuration according to the invention, in the 

form of long narrow strips, those items of depth information are no longer 
misinterpreted by virtue of light-dark boundaries on the surface of the 
object 7. 

Figures 11 and 12 show the use of corresponding PMD-elements in 
10 the highly sensitive reception of optical signals by means of phase 
regulating circuits, PLL and DLL. 

Figure 11 shows an optical PLL-circuit or DLL-circuit with a PMD- 
pixel as electro-optical mixing element which has a very high level of 
sensitivity as can advantageously be used in light barrier arrangements, 
15 as a PLL-array in time-lapse cameras, in optical remote controls and in 
data light barrier assemblies as well as for the regeneration of data signals 
in optical communications. An optical PMD-PLL can be highly integrated as 
the usual reception-HF-amplifier which is connected downstream of the 
photodiode and the electronic mixer are completely eliminated because 
20 the photomixing detector PMD with the reading-out circuit 31 at the 
output 34 already provides the mixed product in the low frequency range 
in the form of a low pass-filtered difference signal U 4 - const • (i a -i b ). The 
phase regulating circuit is connected by way of a loop filter or a digital 
regulator. 

25 It can be used for many modulation modes, for example for sine, 

rectangular, frequency, phase modulation and for code multiplexing, for 
example PN-encoding. In that case the voltage-controlled generator 33 is 
set to the clock rate and modulation to be received. When the phase 
regulating circuit is latched data signals which in the case of the wide- 

30 band PMD according to the invention occur at a wide-band sum output 35 
of the reading-out circuit 31 or by way of a wide-band photodiode with 
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amplifier, which is operated in parallel with the same optical data signal, 
can be regenerated with a 1/0-decision element 32 by virtue of clock 
recovery of that kind. For that purpose the optical 1/0-data signals are 
preferably encoded as return -to-zero (RZ)-signals. 
5 Figure 12 shows a 2Q-PMD-DLL with which even higher levels of 

sensitivity can be achieved on the basis of an IQ-PMD-receiver, in 
particular with PN-modulation. 

As in the above-mentioned patent applications to the same 
applicant, which form the basis for this patent application, periodic PN- 

10 modulation affords great advantages in terms of PMD-reception, in 
particular the possibility of multi-channel selectivity, multi-target detection 
and the highest degree of sensitivity in respect of phase transit time 
resolution. In accordance with the invention it is also possible to use PN- 
encoded data signals for data fight barrier arrangements inclusive of 

15 distance measurement and for optical CDMA-data transmission, for 
example, as shown in Figure 12, In that respect for example a logic '1' 
corresponds to a normal PN-word whereas a logic '0' corresponds to the 
inverted PN-word = PN , that is to say the light/dark chips are 
interchanged. In contrast to Figure 11 in Figure 12 it is the difference 

20 output voltage that is formed as the difference of the quantitative 
differences of the photocurrents: U A = const • ( I i a -i b ) I - ii c -idl)- By means 
of the recovered word clock it is possible to regenerate the data signal of 
the PN-encoded 1/0-data sequence by a procedure whereby in the 
summing amplifier the sum of the differences of the photocurrents U r = 

25 const • ( I i a -ib) I - I ic-i<j ! ) is respectively formed by way of a PN-word length 
by means of a short-term integrator contained in the summing amplifier 
and in the 1/0-decision element the 1/0-decision is taken in clock- 
synchronous manner for subsequent evaluation or regeneration. 

With a VCO with sine modulation for the modulation voltage and 

30 with T chip = T/4 of the sine period it is also possible to detect and 
regenerate vector modulation. 



19 



CLAIMS 



1. An apparatus for detecting the phase and amplitude of 
electromagnetic waves, preferably in the optical and in the near infrared 
and ultraviolet range, comprising at least two modulation photogates (1, 
2) which are sensitive to the electromagnetic waves (photosensitive) and 
accumulation gates (4, 5) which are associated with the modulation 
photogates and which are not photosensitive or shaded, and electrical 
connections for the modulation photogates (1, 2) and the accumulation 
gates (4, 5) so that the latter can be connected to a reading-out device 
and the former can be connected to a modulating device which increases 
or reduces the potential of the modulation photogates (1, 2) relative to 
each other and relative to the preferably constant potential of the 
accumulation gates (4, 5) corresponding to a desired modulation function, 
characterised in that there are provided a plurality of modulation 
photogates (1, 2) and accumulation gates (4, 5) in the form of long 
narrow parallel strips which group-wise form a PMD-pixel, wherein the 
accumulation gates are in the form of reading-out diodes with preferably 
in each case the cathode as the reading-out electrode. 

2. Apparatus as set forth in claim 1 characterised in that the width 
of the modulation photogates is greater than the width of the 
accumulation gates. 

3. Apparatus as set forth in claim 1 or claim 2 characterised in that 
the width of the individual modulation photogates is of the order of 
magnitude ofthe wavelength or in particular for the remote infrared range 
also less than the wavelength of the electromagnetic radiation to which 
the modulation photogates are sensitive. 
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4. Apparatus as set forth in one of claims 1 through 3 characterised 
in that the strip length of the modulation photogates (1, 2) and the 
accumulation gates (4, 5) is more than ten times and preferably more 
than fifty times the wavelength of the electromagnetic radiation to which 
the modulation photogates are sensitive. 

5. Apparatus as set forth in one of claims 1 through 4 characterised 
in that there are provided a plurality of modulation photogates in paired 
parallel mutually juxtaposed relationship, wherein each of the modulation 
photogates (1, 2) of such a pair is connected to another modulation 
connection so that the modulation photogates (1, 2) are modulatable in 
push-pull relationship, wherein a respective accumulation gate (5, 4) is 
arranged between a pair of modulation photogates (1, 2) and a next 
adjacent further pair of modulation photogates (2, 1) and wherein the 
modulation photogates (1, 2) of the two pairs, which are immediately 
adjacent to a respective accumulation photogate (4, 5), are connected or 
electrically joined to the modulation connections in such a way that their 
modulation occurs respectively in push-pull mode. 

6. Apparatus as set forth in one of claims 1 through 5 characterised 
in that a plurality of modulation connections (mi, m 2 , m 3 ) are arranged at 
substantially equal spacings along the length of the strips and are 
connected to the modulation photogates (1, 2). 

7. Apparatus as set forth in one of claims 1 through 6 characterised 
in that the modulation photogates immediately adjoining the accumulation 
gates (4, 5), on the side towards the accumulation gates, partially involve 
a covering by a contacting strip of high conductivity and of no or very low 
transparency for the electromagnetic waves. 
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8. Apparatus as set forth in one of claims 1 through 7 characterised 
in that the apparatus has one or more pixel elements, wherein a pixel 
element comprises a plurality of pairs of modulation gates (1, 2) and 
accumulation gates (4, 5), wherein the strip directions of adjacent pixel 
elements at different modulation voltages are preferably perpendicular to 
each other and wherein transversely with respect to the strip direction the 
ends of the pixels are defined by at least one respective modulation 
photogate (1, 2) which adjoins a next inwardly disposed accumulation 
gate (4, 5). 

9. Apparatus as set forth in claim 8 characterised in that the 
accumulation gate connections are provided at a respective end of the 
strips of a pixel, wherein each second accumulation gate is connected to a 
respective one of two reading-out lines (for example K+) and the other 
accumulation gates are connected to the respective other one of the 
connection lines (corresponding to K-), wherein the reading-out lines lead 
to an evaluation circuit. 

10. Apparatus as set forth in claim 8 or claim 9 characterised in that 
two pixel elements (10, 10') are arranged with their strips parallel and in 
directly mutually juxtaposed relationship so that the mutually immediately 
adjacent modulation photogates which define the mutually juxtaposed 
ends or sides of the two pixel elements (10, 10') form a pair of modulation 
photogates (1, 2) which are modulatable selectively in push-pull mode or 
phase-displaced relationship, whereby either a single pixel element of 
double the size is formed or two independent measurement procedures, 
for example of an in-phase signal and a quadrature signal, are possible 
with the two pixel elements. 

11. Apparatus as set forth in one of claims 8 and 9 characterised in 
that four pixel elements are arranged in a rectangle, wherein the strips of 
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the pixels which are disposed in diagonally opposite relationship in the 
rectangle respectively extend parallel to each other while the strips of the 
immediately adjacent pixel elements extend perpendicularly to each other, 
and wherein the modulation connections are connected in such a way that 
modulation of adjacent pixel elements (10) can be effected in phase- 
shifted relationship, more specifically preferably through 90° in each case. 

12. Apparatus as set forth in claim 9 characterised in that each of 
the pixel elements (10) is respectively of a substantially square shape and 
the four pixel elements are assembled to form a square or that the 
corners are additionally cut off in such a way that substantially an 
octahedron shape is formed. 

13. Apparatus as set forth in claim 12 characterised in that the four 
pixel elements are selectively combined individually (4-quadrant 
operation) or doubly in diagonal relationship (2-quadrant operation) or in 
quadruple relationship (1-quadrant operation), wherein in the case of 4- 
quadrant operation and 2-quadrant operation the gradient or normal 
vector of the surface element is additionally evaluated. 

14. Apparatus as set forth in one of claims 1 through 12 
characterised in that the modulation photogates and the accumulation 
gates and the associated signal evaluation peripheral equipment and 
modulation peripheral equipment are produced in part on-chip and in part 
as a multi-chip module using CMOS-technology or BICMOS-technoiogy. 

15. Apparatus as set forth in one of claims 1 through 14 
characterised in that arranged over the modulation photogates (1, 2) are 
strip lenses which focus substantially all the light incident on the surface of 
a pixel element exclusively on to the modulation photogates (1, 2). 
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16. Apparatus as set forth in one of ciaims 1 through 15 
characterised in that a plurality of pixels are arranged in a linear or matrix 
array. 

17. Apparatus as set forth in one of claims 1 through 16 
characterised in that in a linear or matrix array both PMD-pixels with 3D- 
functionality and also conventional CMOS-pixels with 2D-functionality are 
used in mixed mode, wherein the various and in particular adjacent items 
of pixel information are passed to a data-fusioning and interpolating 
device for reconstruction of the depth image. 

18. Apparatus as set forth in claim 16 and claim 17 characterised in 
that preferably there is associated with each PMD-pixel a microlens which 
concentrates the light incident on the array substantially on to the 
photosensitive surface of the individual pixels. 

19. Use of an apparatus as set forth in one of claims 1 through 18 
characterised in that the apparatus is used as a photosensitive image- 
recording element in a camera. 

20. Use of the apparatus as set forth in one of claims 1 through 18 
characterised in that the apparatus is used in optical signal processing as 
a frequency- and phase-sensitive mixing or correlation element for signal 
acquisition, processing and noise suppression. 

21. A method of operating an apparatus as set forth in one of 
claims 1 through 18 characterised in that a scene of which an image is to 
be produced is illuminated with a light modulated in accordance with a 
modulation function, wherein the modulation photogates (1, 2) are 
modulated with the same but now bipolar or push-pull modulation function 
and wherein selectively for half of a 2-quadrant or 4-quadrant pixel of the 



24 



pixels 90° phase-shifted modulation is effected in the case of sine 
modulation or a bit width in the case of rectangular modulation or a chip 
width in the case of PN-modulation of the modulation photogate voltages. 

22. Use of an apparatus as set forth in one of claims 1 through 18 
characterised in that the apparatus is used in an optical PLL-circuit or DLL- 
circuit which is preferably highly integrated and is preferably used in light 
barrier arrangements, as a PLL-array in time lapse cameras, in optical 
remote controls and in data light barrier arrangements and for the 
regeneration of data signals in optical communications with various 
modulation modes. 

23. Use of an apparatus as set forth in one of claims 1 through 18 
and 22 characterised in that the apparatus is used in an optical PLL- or 
DLL-circuit with a 2Q-PMD-DLL on the basis of an IQ-PMD-receiver, in 
particular with PN-modulation, wherein digital PN-encoded data signals are 
used for multi-channel selection, multi-target detection and for highest 
sensitivity in phase transit time resolution, wherein the difference output 
voltage is formed as the difference of the quantitative differences of the 
photocurrents as U A = const • ( i i a -i b ) | - | i c -i d | ) and is fed back by way of a 
loop filter or a digital regulator as a control parameter of the voltage- 
controlied multivibrator to the chip frequency and wherein the data signal 
of the PN-encoded 1/0-data sequence is regenerated by means of the 
recovered word clock by a procedure whereby in the summing amplifier 
(41) the sum of the differences of the photocurrents Uv = const • ( I i a -ib) I - 
|i c -idl) is respectively formed over a PN-word length by means of a short- 
term integrator contained in the summing amplifier. 
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Abstract of the Disclosure 



Apparatus and Method for Detecting the Phase 
And Amplitude of Electromagnetic Waves 



The present invention concerns an apparatus for detecting the phase and 
amplitude of electromagnetic waves, comprising at least two modulations photogates 
which are sensitive to the electromagnetic waves, and accumulating gates which are 
associated with the modulation photogates and which are not photosensitive, and 
electrical connections for the modulation photogates and the accumulation gates so that 
the latter can be connected to a reading-out device and the former can be connected to a 
modulating device which increases and reduces the potential of the modulation 
photogates relative to each other and relative to the preferably constant potential of the 
accumulation gates corresponding to a desired modulation function. It is proposed in 
accordance with the invention that a plurality of modulation photogates and accumulation 
gates are provided in the form of long narrow parallel strips which group-wise form a 
PMD-pixel. 
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applicatiou(s) !i$ted below and. insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States application in the manner provided by the 
first paragraph of Title 35, UnireH States Code, §1 12, 1 acknowledge the duty to disclose material 
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infornution as defined in Title .37, Code of Federal Regulations, §1 .56(a) which occurred 
between the filing date of the prior application and the national or FCT international filing dale 
of the application: 



(Application Serial No.) 



(Filing Date) 



(Status) 
(patent, pending, abandoned) 



(Application Serial No.) 



(1,'iiing Date) 



(Status) 
(patent, pending, abandoned) 



I hereby appoint the following attorneys and/or agents to prosecute this application and to 
- lransa^alliusracssiathe-P^ . . 



Address all telephone calls to John F. McNoIly at (215) 568-4900. 

Address all correspondence tojojui P. McNulty at Paul &_?_ml_2$Q0 Two Thog5ar^\fakgt_ 

I hereby declare that all statements made herein of my own knowledge arc true and that ail 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under §1 001 of Title IS of the United States Code 
and that such will fut false statements may jeopardize the validity of the application or any patent 
issued thereon. 




<2£02fiL 



Ounnajsd S. Ojan , c _3 g,065 
Mohammad S. Rahman -43*02§_ 
Hoang Steve Ngo 42,932 



John F. McNulty 
Alex R SUnsas 



Fuil name of sole oi 
Inventor signature*! 





Citizenship German 
Post Office Address Krcu*6ilci; Strasse 5G, D-57250 Notphen, Germany 
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